S3Drive - off-topic

@Xenthys I wanted to say thanks again for the policy. I said, I would share it and almost 20 people found it helpful within 12 hours

7:03 PM

1

7:03 PM

This is on Lemmy

️

Morethanevil

@Xenthys I wanted to say thanks again for the policy. I said, I would share it and almost 20 people found it helpful within 12 hours

You're welcome, glad it helped you, if it helps others that's a bonus haha

1

Morethanevil

@Xenthys I wanted to say thanks again for the policy. I said, I would share it and almost 20 people found it helpful within 12 hours

I am wondering if you also face directory cache listing issue on MinIO. Playing with MinIO and uploaded some files, then deleted them all, they've landed in Trash, but when I open Files, the directory structure remains even though these entries are effectively deleted. It's been many hours since delete took place, but the dir structure is still there. (edited)

Do you use versioning for this bucket?

8:25 AM

Test upload to a bucket with versioning

8:25 AM

Far better view

1

8:26 AM

Deleted all with normal delete

8:27 AM

I can reload the bucket as I want, those elements are not coming back in s3drive

Morethanevil

Do you use versioning for this bucket?

I do have versioning enabled and problem only affects folders. In other words if you delete a folder with some files it seems that empty "folder entry" still appears in the listing.

Okay I test again

9:35 AM

... and then once you refresh view, what happens? (edited)

Yes when I switch the tab I get your Problem

9:36 AM

Yes folder reappears

9:36 AM

Not reappears

9:36 AM

It is recreated

9:37 AM

I see the same in MinIO Webinterface

It seems it's related to this issue: https://github.com/minio/minio/issues/10914#issuecomment-731380100 I am going to investigate that, something's not right with Minio's behavior

Yes i tried to delete folder, it appears in the app as deleted but is still there in MinIO It does not get deleted in the first place

9:40 AM

The app is correctly listing the bucket

Well they way it all works it's maybe not complex, but convoluted. There is no concept of directories in S3, so there are sort of virtual directory entries. There are explicit folder entries (e.g. if key: "folder/" - slash is important) gets created and there are implicit entries (e.g. if key: "folder/file.txt" exists) then "folder" gets "derived" from the path. (edited)

Okay nothing wrong I have a clue: You have versioning enabled, so deleted files are marked as deleted but are kept back The folder which contains is not empty in this case and can not get deleted I tried to normally delete in MinIO it did not work As i made hard delete (=deletes all versions) then it worked

9:43 AM

So versioning is correctly working and S3Drive is listing right

9:44 AM

Maybe you should add the option to show deleted files

9:44 AM

A toggle in the menu would be okay

Well, Trash is supposed to show deleted files really. It's actually using Versioning API to display what's deleted. It seems that MinIO incorrectly displays the directory listings if there are Delete Markers left and guys from Nextcloud developed a workaround/hack: https://github.com/nextcloud/files_versions_s3/issues/11#issuecomment-945771673 to hide these entries. (edited)

9:48 AM

I am going to play with different S3 implementations to confirm my findings, but it seems this is purely MinIO related.

that's a MinIOops I guess

2

1

Tom

Well, Trash is supposed to show deleted files really. It's actually using Versioning API to display what's deleted. It seems that MinIO incorrectly displays the directory listings if there are Delete Markers left and guys from Nextcloud developed a workaround/hack: https://github.com/nextcloud/files_versions_s3/issues/11#issuecomment-945771673 to hide these entries. (edited)

Is there an issue related to that on MinIO Page?

Morethanevil

Is there an issue related to that on MinIO Page?

Bear in mind that most of the cases where S3 is used is simply key<>value storage, where files metadata and structure/hierarchy is being kept elsewhere. Directories on S3 is literally a hack (which actually works) and using S3 natively as FS (that's what we do) is rather an edge case. I haven't found anything official really, as I was wasting my time trying to search for some "cache" settings... but after x hours and then node restart I've realized that there is more to this. (edited)

I don't think it is about caching, it is more a point of view problem You have files in a folder and delete them. Now they are marked as deleted but versioning keeps them as expected. If you niw delete the folder and would get the mark of deleted, then you won't be able to restore the files because the folder is still deleted

And how would you list the deleted of deleted files?

10:25 AM

Deletception

10:26 AM

MinIO would need to unmark the deleted files and would need to set it to the whole folder. But there is a expiry function for deleted files. This would be reset

10:26 AM

This is what I think, or am I wrong

10:27 AM

Morethanevil

I don't think it is about caching, it is more a point of view problem You have files in a folder and delete them. Now they are marked as deleted but versioning keeps them as expected. If you niw delete the folder and would get the mark of deleted, then you won't be able to restore the files because the folder is still deleted

And how would you list the deleted of deleted files?

To put things simply, it works on AWS S3 it doesn't on MinIO. I am building some bash evidence and going to ask publicly on MinIO's Github. The issue isn't complex at all. Basically you have trash on Windows/Linux/macOS whatever. If you delete files from your computer, they land in Trash. We can say they're versioned as their latest version is available for restore. From a UI point of view, after deletion, you wouldn't expect for these deleted entries to appear in a location from where they were originally deleted. They're now in Trash (available for further deletion or restore) and shouldn't be present anywhere else. MinIO shows the folder hierarchy in the original location despite that it was all deleted and it's correct place is Trash. I don't think it's a correct behavior from purely "files&directories" UI point of view. (edited)

Yes this makes sense

... and it's also inconsistent, because it doesn't show deleted files, but it shows deleted directories only

If you opened an issue, I would like have a link. Want to keep an eye on this

Morethanevil

If you opened an issue, I would like have a link. Want to keep an eye on this

Hey, how are you doing? I am not sure if I actually ever replied to you, but that's the issue: https://github.com/minio/minio/issues/17810 In the meantime we've found one more issue and inconsistency with AWS S3: https://github.com/minio/minio/issues/18148 In other words if you create a tree like this.

PUT folder/
PUT folder/file.txt

then: LIST folder might not return you the folder/file.txt Apparently they mention it in here: https://min.io/docs/minio/container/operations/checklists/thresholds.html#id6 I am not sure, but we may have to change the way we create folders to overcome this issue. E.g. instead of folder/ we would rather create folder/.empty to not cause conflicting keys.

Thanks for the reply, I read the thread. If you now have a workaround, it is good

Morethanevil

Thanks for the reply, I read the thread. If you now have a workaround, it is good

Hey, how are you? Just FYI, we've included MinIO workaround in 1.6.0 release: https://s3drive.app/changelog

Hey, I am fine but busy with my daughters

️

I read about the workaround. Thanks

That implies at least two girls, lucky man !

Twins

10y old

1

Hi, what's the difference between the playstore ultimate plan and the one available in the website?

I assume the Play Store one is more expensive? If so, that would be due to Google's fees, you can buy on the website directly if you're interested.

Mic

Hi, what's the difference between the playstore ultimate plan and the one available in the website?

Leaving price difference aside, in-app purchase on Android applies only Android. With iOS there is an Apple's Universal Purchase (https://developer.apple.com/support/universal-purchase/), so it's also linked to desktop macOS version. Licenses sold on our website are valid on all platforms.

Tom

Leaving price difference aside, in-app purchase on Android applies only Android. With iOS there is an Apple's Universal Purchase (https://developer.apple.com/support/universal-purchase/), so it's also linked to desktop macOS version. Licenses sold on our website are valid on all platforms.

Ok thank you, so purchase on playstore is android only got it. Other question, a couple of months ago i was checking the subscriptions and if i remember correctly you were able to buy an annual license and keep the features that were releaesed during that year. Is it still available?

That's our #general conversation, feel free to read the last few messages there blobwink

how to reset a password? the link that I am receiving to my email always logged me in, instead of resetting it

web platform seems cannot reset a password properly, but I tried using my iPhone via Gmail to Safari it seems the app links get detected and properly goes to the Reset Password from the app. Thus, iOS app reset password works properly.

Hi @daison, thanks for reporting, we will check the web platform. In principle the reset password link logs you in automatically and then redirect you to the password change: https://web.s3drive.app/password-change We're in the process of improving our auth provider to further improve this workflow.

S3Drive - Zero Knowledge E2E encrypted storage

Easy-to-use client that converts any S3 server into your personal encrypted file storage. Rclone compatible, mount as drive, WebDav server, file versioning.

1

I'm trying the music playlist feature, but no sound coming out even ringtones

4:46 AM

I also noticed that APKs are not available anymore. Will you offer that in the future? Perhaps a self updating one? (edited)

4:50 AM

And would it be possible to implement a media AI similar to Immich/Google Photos?

InfiniteAds559

I'm trying the music playlist feature, but no sound coming out even ringtones

Thanks for letting me know. Does the play-out issue apply to all music media format? We've used APK as a workaround before Google approved our Folder sync permissions. We will likely provide APK in the future, but it does require some resources that we've redirected elsewhere. Media AI it's on the radar, but realistically we will start work on 2025, as 2024 is mostly about storage, syncing, integration with files and hosted plans.

Yes, FLAC, MP3, and OPUS. it plays the song but no sound.

11:53 PM

Re: APK. Not a deal breaker. It's nice for folks who are trying to avoid the Google Play Store. Probably a long shot, but is it possible to remove Google libraries for the Github APK?

11:57 PM

Re: Media AI. That's exciting! I'm pretty content with how the app progressed.

@InfiniteAds559 FWIW I was using Obtanium to get the apk directly from github

InfiniteAds559

Yes, FLAC, MP3, and OPUS. it plays the song but no sound.

In a newer release we've improved the audio player. We haven't found any issues with audio no playing. Can you provide your phone model and OS version please?

Ari

@InfiniteAds559 FWIW I was using Obtanium to get the apk directly from github

Thanks for letting me know. I remember that I've used some alternative to Play Store, which wasn't using Google API, but could browse and install apps from Play Store. EDIT: Got it, it was Aurora Store (edited)

1

Tom

In a newer release we've improved the audio player. We haven't found any issues with audio no playing. Can you provide your phone model and OS version please?

it's a base s23 on android 14/oneui6 app version 1.7.12. so when i click the mp3 file, it does nothing, but clicking the open with plays the file. is this the inteded behaviour?

InfiniteAds559

it's a base s23 on android 14/oneui6 app version 1.7.12. so when i click the mp3 file, it does nothing, but clicking the open with plays the file. is this the inteded behaviour?

That's definitely not intended. As long as it's an audio file it should be recognized as such (there is an .mp3 icon regardless for every audio file), therefore tapping on it shall by default open the audio player. With next release there will be an improvement, so encrypted audio files will be decrypted on the fly and played out. Perhaps your file was encrypted? (edited)

how do I add the change log to an rss feed?

1

InfiniteAds559

how do I add the change log to an rss feed?

It's not yet RSS compatible, however great idea, we will make it work with RSS pretty soon.

Tom

Thanks for letting me know. I remember that I've used some alternative to Play Store, which wasn't using Google API, but could browse and install apps from Play Store. EDIT: Got it, it was Aurora Store (edited)

U mean wherever I download S3drive it was not reliable to Google gms Api，so we can use it on those android mobile phone's without GMS support

Hi @mix9311, I've moved your question here.

what's the difference between alist and rclone

I am not exactly sure, as I've just came across this project. The main difference to me is that alist has its own Web front-end, so you can self-host it yourself and then expose back-end to other users: https://al.nn.ci/ With Rclone that's not possible yet, you can use: https://rclone.org/commands/rclone_serve/ however there is no documentation how to "host" serve command permanently e.g. on your self-hosted server. One more difference is selection of supported back-ends. Alist seem to target Chinese providers which Rclone doesn't support at the moment.

rclone serve

Serve a remote over a protocol.

I think I understand. Thank you.

Thinking of the possibilities of this app once the sync and write mount have been ironed out - would we able to automatically sync and backup between devices without having to use yet another app ie Kopia/Borg/FreeFileSync? Also, would a feature to auto sync only when a HDD is connected?

InfiniteAds559

Thinking of the possibilities of this app once the sync and write mount have been ironed out - would we able to automatically sync and backup between devices without having to use yet another app ie Kopia/Borg/FreeFileSync? Also, would a feature to auto sync only when a HDD is connected?

We haven't touched backup specific scenarios, as there are multiple solutions already out there. Instead of reinventing the wheel we might actually integrate existing libraries, e.g. Kopia (in a same way as we did for Rclone) and then create UI on top of it. Alternatively we could create some basic backup options just to start with using existing tools (e.g. Sync). When you say "backup between devices", do you mean a similar to Syncthing direct communication? At the moment with S3Drive you can set up <DeviceA> -> <SomeS3OrRcloneBack-end> -> <DeviceB> flow. Would that work for you?

would a feature to auto sync only when a HDD is connected?

Once we have some basic backing up tools, yes, we could implement some logic around that, probably requires some research, e.g. relying on drive letter (e.g. on Windows) might not be good enough, so some disk S/N pinning would be required. We haven't thought about that just yet.

Hi all, I’m Kateryna, a Flutter dev. Nice to e-meet you! I recently launched a Flutter-based Windows app that works perfectly on Windows 11 but unfortunately the HTTP requests doesn't work on Windows 10 due to an SSL error (screenshot attached). @Tom I’ve searched everywhere for a solution but haven’t had any luck so far. I’m reaching out to ask: how did you handle this issue in S3drive? Any guidance would mean the world to me. Thank you so much for your time and help!

Hi @otzibrod, we don't really provide support for Flutter, but being proud of using this tech would be happy to help out. Do you have perhaps the Minimal Reproducible Example? What's your OS/release on the build machine? https://endoflife.date/windows ... and on what OS/release you report a certificate isuse ... and on what OS/release this problem no longer appear? Such information would potentially allow to narrow down changes (e.g. certificate list) between the releases and hopefully track down the issue. What's output of flutter --version and flutter doctor? (edited)

otzibrod

Hi all, I’m Kateryna, a Flutter dev. Nice to e-meet you! I recently launched a Flutter-based Windows app that works perfectly on Windows 11 but unfortunately the HTTP requests doesn't work on Windows 10 due to an SSL error (screenshot attached). @Tom I’ve searched everywhere for a solution but haven’t had any luck so far. I’m reaching out to ask: how did you handle this issue in S3drive? Any guidance would mean the world to me. Thank you so much for your time and help!

I'm getting this exact same error while trying to access an S3 bucket on my own storage device.. It's just from my laptop. when i try to access the bucket from my pc everything seems to work fine.. seems to be a windows issue.. haven't found the resolution yet though.

Milaina

I'm getting this exact same error while trying to access an S3 bucket on my own storage device.. It's just from my laptop. when i try to access the bucket from my pc everything seems to work fine.. seems to be a windows issue.. haven't found the resolution yet though.

Hi, have you tried connecting on Android or other machine? There are couple possible causes. a) Your network is misconfigured, please see: https://discord.com/channels/1069654792902815845/1069654792902815848/1315450964500676659 b) Endpoint that you try to connect is using untrusted SSL certificate, more on that here: https://discord.com/channels/1069654792902815845/1315049966028456029/1315055688615067749